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Computer  Program  Teet: 
Flowchart  Graphs 
Adjacency  Matrix 
Zero-One  Linear  Progri 
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Tasting 


This  report  discusses  the  use  of  flowchart  graphs,  adjacency  matrices,  and 
sero-ona  linear  progressing  to  find  the  nlnlnus  number  of  tasts  necessary  to 
execute  every  sagwent  of  a cowputer  progran  at  least  once.  The  nethode  of 
Llpow  are  used  as  the  basis  for  determining  the  naxlii  lncowparable  set,  l.e. , 
the  largest  set  of  program  segments  through  which  one  and  only  one  test  case 
should  pees.  The  else  of  the  mawlmms  Incomparable  set  gives  the  nlnlmem  number 
of  testa  necessary  to  execute  each  segment  at  least  once,  while  the  elements  of 
this  set  give  the  paths  of  each  test.  The  report  develops  nathoda  for  finding  ■ 
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1.0  Introduction 


This  report  discusses  various  aspects  of  verifying  that  a computer 
program  correctly  carries  out  some  specified  functions.  If  the  program  was 
designed  with  the  aid  of  a flowchart,  the  flowchart  can  be  used  to  determine 
the  number  of  tests  necessary  to  verify  the  program.  If  the  program  was  pre- 
pared without  a flowchart,  then  either  a flowchart  or  a directed  graph  (as 
described  in  2.0)  must  be  prepared  from  the  program,  to  determine  the  number 
of  tests. 

One  way  to  verify  a computer  program  is  to  run  it  with  sample  input  data 
and  examine  the  results  for  correctness,  i.e.,  test  for  agreement  between  the 
program  output  and  the  results  that  would  be  produced  by  correct  execution  of 
the  specification  on  the  same  data.  This  requires  prior  determination  via 
hand  computation  or  other  independent  means  of  the  correct  outputs  for  the 
sample  Inputs.  It  is  useful  for  us  to  first  classify  the  different  types  of 
tests  which  we  will  be  discussing.  A level  zero  test  is  defined  as  a test 
consisting  of  one  or  more  test  cases  which  together  cause  every  program 
statement  to  be  executed  at  least  once. 

Before  defining  a level  one  test,  it  is  necessary  to  define  a program 
segment,  which  we  shall  do  in  terms  of  flowchart  terminology.  In  general  our 
flowcharts  will  consist  of  one  start  and  one  stop  terminal  (ovals),  procers- 
ing  elements  (rectangles  or  parallelograms),  and  decision  elements  also 
called  deciders  (diamond  shape).  A segment  Is  any  flow  sequence: 

a)  from  the  START  terminal  to  the  first  decider, 

b)  from  the  exit  of  one  decider  to  the  entry  of  another, 

c)  from  the  last  decider  to  the  STOP  terminal, 
whether  or  not  any  of  these  flows  contain  processing  steps. 

A subroutine  is  considered  part  of  a segment  if  the  segment  contains  a 
call  to  the  subroutine.  Segments  may  overlap,  i.e.,  a processing  step  may  be 
contained  in  more  than  one  segment.  If  a program  contains  more  than  one  STOP 
terminal,  then  a group  of  segments  is  formed  by  the  flow  to  each  terminal 
from  the  respective  last  decider. 

The  flowchart  of  Figure  1 can  be  used  to  illustrate  the  definition  of  a 
segment.  The  flowchart  contains  seven  segments,  numbered  from  0 to  6.  Seg- 
ment 1 is  clearly  the  flow  from  the  exit  of  one  decider  to  the  entry  of  ano- 
ther, even  though  the  flov  contains  no  processing  steps.  The  subroutine 
called  in  segment  3 is  completely  contained  in  segment  3,  regardless  of  any 
deciders  that  appear  in  the  subroutine.  Segment  2 consists  of  all  the  flow 
from  the  exit  of  decider  A to  the  entry  of  decider  C.  Segment  4 consists  of 
all  the  flow  from  B to  C,  and  part  of  segment  4 overlaps  part  of  segment  2 
(they  share  the  processing  step  3).  A level  one  test  consists  of  one  or 
more  test  cases  which  together  cause  every  program  segment  to  be  executed 
at  least  once. 
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FIGURE  1 THE  FLOWCHART  FOR  THE  EXAMPLE. 


A path  in  a computer  program  Is  any  way  of  getting  from  the  start  termi- 
nal to  tha  stop  terminal,  or  to  each  of  the  stop  terminals,  if  the  program 
contains  more  than  one.  If  the  flowchart  contains  loops,  each  different  way 
of  getting  from  start  to  stop,  including  different  numbers  of  times  around 
the  loops,  constitutes  a path.  This  may  lead  to  situations  where  the  number 
of  paths  is  very  large  or  difficult  to  determine  from  the  flowchart,  such  as 
when  the  loop  control  is  defined  in  some  complex  way  or  when  it  depends  on 
input  data  as  in  Figure  2.  Even  when  the  loop  control  is  mare  straightforward 
the  number  of  paths  can  be  very  large.  Figure  3 shows  a flowchart  where  the 


FIGURE  2 AN  INPUT- CONTROLLED  LOOP. 


N+ 

number  of  paths,  p,  depends  on  a single  value  of  input  data,  where  p = 3 
Since  N can  be  the  largest  integer  that  can  be  stored  in  the  computer,  the 
number  of  paths  is  very  large  indeed. 


A level  two  test  is  one  that  executes  every  program  path  at  least  once. 

A level  three  test  is  one  which  includes  all  possible  sets  of  input  data. 
Level  two  and/or  level  three  tests  might  have  formerly  been  called  "exhaus- 
tive tests,"  but  the  new  definitions  based  on  levels  are  more  precise  and 
should  replace  the  earlier  usage.  Level  two  and  level  three  tests  are  not 
always  as  exhausting  (to  the  programmer)  as  they  might  at  first  seem.  There 
are  some  particular  types  of  problems,  especially  those  dealing  only  with 
integer  variables,  that  have  a sufficiently  limited  set  of  input  possibili- 
ties to  make  a level  two  or  level  three  test  practical.  However,  in  general 
level  two  and  three  lists  are  intractable. 

In  this  report,  attention  will  be  directed  mainly  to  level  one  and  rela- 
ted types  of  tests.  That  is,  we  will  discuss  tests  which  are  oriented  to  the 
testing  of  program  segments.  Drawing  on  the  work  of  M.  Lipow  [1],  it  will  be 
shown  how  graphs,  matrices,  and  zero-one  integer  linear  programming  [4]  can 
be  used  to  determine  the  number  of  test  cases  needed  to  perform  a level  one 
test,  and  the  data  needed  to  comprise  those  test  cases. 

In  addition.  Section  3 of  this  report  contains  a discussion  of  methods 
of  estimating  the  number  of  paths  in  a loopless  flowchart. 


2 . 0 Graphs 


In  this  section  we  will  examine  techniques  for  computing  the  number  of 
test  cases.  As  examples  we  will  consider  the  testing  of  one  unstructured 
program  and  two  structured  programs.  For  the  purpose  of  this  r-'rort,  : - is 
sufficient  to  define  a structured  program  as  one  in  which: 

a)  each  major  function  of  the  program  is  coded  in  its  own  "module," 
(i.e.,  function  or  subroutine), 

b)  no  GOTO  statements  are  used. 

First,  a formal  method  of  determining  the  number  of  test  cases  needed  to 
perform  a level  one  test  will  be  described;  secondly,  the  method  will  be  ap- 
plied to  the  three  programs  in  question;  finally,  experience  in  testing  the 
three  programs  will  be  discussed. 


2.1  Method  of  Determining  the  Number  of  Test  Cases  Needed  to  Perform  a 

Level  One  Test  — (Lipow's  Method). 

For  the  description  of  Lipow's  method  using  graphs  [l] , we  will  use  the 
flowchart  given  by  him  and  repeated  here  in  Figure  4.  The  flowchart  solves 
the  following  problem:  "Determine  whether  three  integers  representing  three 
lengths  constitute  an  equilateral,  isosceles,  or  scalene  triangle,  or  cannot 
be  the  sides  of  any  angle."  In  this  flowchart  we  will  be  seeking  to  execute 
each  segment  exactly  once. 

To  determine  the  number  of  test  cases  needed: 

a)  number  the  flowchart  segments,  as  has  been  done  in  Figure  5, 

b)  draw  a directed  graph  in  which  the  nodes  of  the  graph  are  the 
segments  and  the  arcs  of  the  graph  show  the  sequence  in  which 
the  segments  may  be  executed. 

This  has  been  done  in  Figure  6,  where  it  is  shown,  for  example,  that  after 
segment  6 is  executed,  then  either  7 or  8 will  be  executed.  Now,  find  the 
maximum  set  of  "incomparable"  elements;  that  is,  the  largest  set  of  nodes 
none  of  which  precedes  or  follows  any  other  node  in  the  set.  In  Figure  6, 
the  set  consists  of  the  11  nodes  24,  23,  17,  11,  l6,  15,  22,  21,  26,  25,  and 
19*  These  all  happen  to  be  at  the  bottom  of  the  graph,  but  we  will  see  that 
this  is  merely  a coincidence. 

After  the  graph  has  been  analyzed,  the  size  of  the  largest  incomparable 
set  is  equal  to  the  number  of  test  cases  required,  and  the  elements  of  the 
set  are  the  segments  through  which  one  and  only  one  test  case  should  pass. 
Section  4 of  this  report  describes  an  algorithm  for  finding  the  size  and 
members  of  the  maximum  incomparable  set. 
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FIGURE  5 — FLOWCHART  WITH  8EGMEHTS  NUMBERED 


FIGURE  6 — GRAPH  DRAWN  FROM  THE  FLOWCHART  IN  FIGURE  5. 

It  should  be  emphasized  that  finding  the  number  of  test  cases  is  only 
part  of  the  task,  and  considerable  additional  work  is  required  to  find  the 
actual  test  cases.  In  the  example  given  in  Figure  7(a),  and  the  associated 
graph  in  Figure  7(b),  by  inspection  ve  can  see  that  6 and  8 are  members  of 
the  Incomparable  set.  If  we  cheese  the  two  test  values  A = +5  and  A = -5, 
segments  1,  4,  6,  and  8 will  b_*  traversed,  but  never  segment  3.  If,  however, 
we  choose  A ■ +15  and  A * -If  as  our  values,  segments  1,  3,  4,  6,  and  8 may 
be  tested  at  least  once.  Thus,  it  is  still  required  to  find  the  appropriate 
test  cases,  even  once  the  mrmber  is  known. 

In  order  now  to  test  the  program,  11  test  cases  must  be  constructed  so 
that  each  one  passes  through  just  one  of  the  segments  of  the  maximum  in- 
comparable set.  In  this  program,  such  test,  cases  can  be  found  by  organized 
trial  and  error,  and  are  given  in  Table  1.  \If  these  11  cases  run  through 
the  program  correctly,  then  the  program  has  undergone  a level  one  test. 

2.2  Extensions  of  Lipow's  Method. 

Any  experienced  programmer  would  see  that  the  11  cases  in  Table  1 do  not 
test  the  program  by  any  "common  sense"  standard. 
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The  case  of  I+J<K  was  included  in  the  test,  but  the  case  of  I+J=K 
was  not,  so  we  have  no  assurance  that  the  equal  condition  would  take  the  cor- 
rect branch.  It  is  clearly  necessary,  then,  to  test  decisions  three  ways 
whenever  possible.  This  really  implies  the  assumption  that  frequent  errors 
are  committed  in  specifying  whether  the  left  or  right  branch  of  a decision 
is  taken  when  the  left  hand  md  right  hand  portions  of  the  decision  expres- 
sion (predicate)  are  equal.  xperience  shows  that  this  is  the  case. 

In  addition,  testin  segment  of  code  only  once  may  be  far  from  ade- 
quate if  the  segment  contains  an  expression  like: 


SQRT(SIN(ALOG(X*Y-A/B) ) )**SQRT(C/D) . 


It  might  be  wise  to  test  an  expression  like  this  more  than  once  to  assure 
that  the  divisions  will  not  cause  underflow  or  overflow,  and  that  nowhere 
will  illegal  arguments  of  functions  develop.  Also,  segments  in  which  sub- 
scripting is  used  would  have  to  be  tested  more  than  once. 

These  decisions  about  what  tests  to  apply  to  which  segments  must  be 
made  by  someone  familiar  with  the  program,  will  be  different  for  different 
programs,  and  will  depend  on  the  complexity  of  each  segment.  This  kind  of 
test,  in  which  each  segment  is  executed  one  or  more  times,  is  defined  as  a 
level  one-point-five  test. 

Let  us  now  attempt  to  perform  a level  1.5  test  on  this  triangle  prob- 
lem, and  determine  the  number  of  test  cases  required.  Since  the  data  are 
all  integers  and  the  assignment  statements  very  simple,  assignment  state- 
ments will  need  to  be  executed  only  once,  as  in  a level  one  test.  But  all 
decisions  must  be  tested  three  ways  where  possible,  for  high,  equal,  and  low 
values.  For  certain  decisions,  however,  we  will  see  that  no  set  of  test 
data  can  exercise  all  three  outcomes  because  not  all  combinations  are  logi- 
cally possible.  Figure  8 shows  a flowchart  in  which  it  may  not  be  possible 


FIGURE  8 — A FLOWCHART  IN  WHICH  ONE  OF  THE  DECISIONS  CANNOT 
BE  TESTED  THREE  WAYS. 
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to  test  the  decision  K < 0 three  ways,  since  no  set  of  test  data  could 

reach  that  decision  with  K > 0 unless  K is  modified  by  the  unspecified 

process  between  the  two  deciders. 

To  determine  the  number  of  test  cases  required  for  a 1.5  test  on  the 
triangle  problem,  renumber  the  segments,  this  time  assigning  to  each  seg 
ment  one  number  for  each  time  that  the  segment  is  to  be  executed  in  the 
test . That  is , to  branches  which  are  to  be  taken  twice  we  assign  two 
numbers;  if  there  had  been  any  segments  that  needed  to  be  executed  more 
than  once  due  to  complex  assignment  statements,  these  too  would  have  been 
given  additional  numbers.  The  renumbered  flowchart  is  shown  in  Figure  9, 

where  segment  1 stands  for  I < J , segment  2 for  I > J , segment  12  for 

I + J < K,  segment  13  for  I + J = K,  and  so  on.  Segment  22  stands  for 
MATCH  >1;  there  can  be  no  segment  for  MATCH  < 1,  since  no  set  of  test 
data  could  reach  that  point  in  the  program  with  MATCH  < 1.  The  graph  of 
this  flowchart  is  shown  in  Figure  10.  The  maximum  set  of  incomparable 
elements  numbers  is  17, and  consists  of  those  segments  appearing  with  an 
asterisk  in  Figure  10. 

The  17  test  cases  are  shown  in  Table  2.  A conventional  program 
realizing  this  flowchart,  written  in  PL/C,  is  given  in  Appendix  A.  The 
output  shown  results  from  the  17  cases  that  test  the  program.  The  test 
cases  were  found  by  organized  trial  and  error. 


TABLE 

2 — 

TEST  CASES  FOR  THE  FLOWCHART  IN 

FIGURE  9. 

Test  No. 

Data 

Path 

Results 

... 

1 

1=4 

J=3 

K=2 

3-6-9-11-14-15-18 

Scalene 

2 

1 

1 

3 

1-5-8-10-21-23 

Not  a triangle 

3 

1 

1 

2 

1-5-8-10-21-24 

Not  a triangle 

4 

2 

3 

2 

2-4-9-10-22-26-28 

Isosceles 

5 

2 

5 

2 

2-4-9-10-22-26-29 

Not  a triangle 

6 

2 

4 

2 

2-4-9-10-22-26-30 

Not  a triangle 

7 

1 

2 

2 

2-5-7-10-22-27-31-35 

Isosceles 

8 

5 

2 

2 

3-6-7-10-22r 27-31-33 

Not  a triangle 

9 

4 

4 

4 

3-6-7-10-22-27-31-34 

Not  a triangle 

10 

3 

3 

2 

1-6-9-10-21-25 

Isosceles 

11 

1 

1 

1 

1-4-7-10-22-27-32 

Equilateral 

12 

0 

1 

2 

2-5-8-11-12 

Not  a triangle 

13 

1 

2 

3 

2-5-8-11-13 

Not  a triangle 

14 

2 

0 

1 

3-6-8-11-14-16 

Not  a triangle 

15 

3 

1 

2 

3-6-8-11-14-17 

Not  a triangle 

16 

1 

2 

0 

2-6-9-11-14-15-19 

Not  a triangle 

17 

2 

3 

1 

2-6-9-11-14-15-20 

Not  a triangle 

11 
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FIGURE  10  — GRAPH  DRAWN  FROM  THE  FLOWCHART  IN  FIGURE  9. 


2.3  Structured  Programming 

We  may  now  take  a "structured  programming"  approach  to  the  same  problem, 
by  first  noting  that  the  flowchart  of  Figure  U has  frequent  crossing  of  flow- 
lines and  much  branching  between  different  areas  of  the  flowchart.  These 
characteristics  of  the  flowchart  give  rise  to  the  many  GOTO  statements  in 
the  program  of  Appendix  A.  We  will  now  attempt  a new  flowchart,  trying  to 
isolate  the  different  functions  of  the  program  from  one  another,  in  order  to 
eventually  produce  easily  readable  code  free  of  GOTO  statements.  A first 
attempt  at  such  a flowchart  is  shown  in  Figure  11.  This  flowchart  is  drawn 
as  if  for  a virtual  machine  having  a capability  of  executing  a decision  on 
whether  the  input  data  constitute  a "valid  triangle,"  and  performing  other 
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FIGURE  11  — HIGH-LEVEL  STRUCTURED  FLOWCHART  FOR  THE  TRIANGLE  PROBLEM. 


high-level  functions.  A detailed  flowchart  of  how  those  functions  are 
carried  out  is  shown  in  Figure  12,  with  the  segments  of  code  numbered. 

The  step  numbered  19,  20,  21  was  given  three  numbers  to  assure  that  three 
test  cases  will  pass  through  it,  one  for  each  type  of  triangle.  A program 
realizing  this  flowchart  is  given  in  Appendix  B . The  program  uses  IF . . . 
THEN... ELSE,  a function,  a CALL,  a DO  loop,  and  a DO  group  to  avoid  all 
GOTO  statements. 

The  graph  drawn  from  the  flowchart  in  Figure  12  is  given  in  Figure  13. 
The  maximum  incomparable  set  consists  of  9 elements.  There  are  four  dif- 
ferent sets  of  9 incomparable  elements,  and  we  can  use  any  of  the  four 
equally  well.  One  of  the  sets  consists  of  the  elements  marked  with  an  as- 
terisk in  Figure  13.  The  other  three  sets  can  be  formed  by  replacing  seg- 
ments 10,  11,  and  12,  with  segments  13,  14,  and  15,  respectively!  with  16, 
17,  and  18,  respectively;  and  with  19,  20,  and  21,  respectively.  In  all 
four  cases  the  members  of  the  incomparable  set  are  pair-wise  unreachable 
from  all  other  members  of  the  set,  which  is  the  definition  of  an  incom- 
parable set. 
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FIGURE  12  — DETAILED  FLOWCHART  FOR  THE  STRUCTURED  PROGRAH. 


■ ■ ■ — 
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Even  though  the  maximum  incomparable  set  is  of  size  9,  it  is  impos- 
sible to  find  only  9 test  cases  that  will  execute  each  member  of  the  in- 
comparable set  only  once.  The  trouble  lies  in  the  way  the  variable 
MATCHES  is  computed.  If  we  want  to  test  the  program  for  all  possible 
values  of  MATCHES  (which  we  do),  it  must  take  on  the  values  0,  1,  and 
3 at  segments  19,  20,  and  21  in  the  flowchart.  In  order  for  MATCHES  to 
have  the  value  3,  one  test  case  r.iust  pass  through  segments  12,  15,  and 
18.  In  order  for  MATCHES  to  have  the  value  1,  one  case  must  pass  through 
any  one  of  12,  15,  or  18  and  neither  of  the  other  two.  Thus  one  member  of 
the  incomparable  Bet  must  have  two  test  cases  pass  through,  bringing  the 
total  number  of  test  cases  to  10.  This  one  example  seems  to  show  that 
the  size  of  the  maxi mum  incomparable  set  serves  as  a lower  bound  on  the 
minimum  number  of  test  cases  required.  Sometimes,  as  in  this  case,  it 
is  not  possible  to  find  tests  which  will  pass  through  only  one  different 
member  of  the  maximum  incomparable  set.  (Section  4 of  this  report  fur- 
ther discusses  lower  and  upper  bounds  on  the  minimum  number  of  cases . ) 

Ten  cases  which  test  the  program,  and  which  generated  the  output 
shown  in  Appendix  B,  are  given  in  Table  3. 


Figure  lU  shows  an  essentially  different  way  of  solving  the  triangle 
problem,  one  which  requires  fewer  test  cases.  The  input  variables  are 
first  sorted  into  ascending  order.  Then  the  required  comparisons  are 


[ TABLE 

3 — 

TEST  CASES  FOR  THE  FLOWCHART  IN  FIGURE 

12. 

Test  No. 

Data 



Path 

Results 

1 

1*1 

J=1 

K=3 

3 

Not  a triangle 

2 

1 

1 

2 

2 

Not  a triangle 

3 

1 

3 

1 

1-6 

Not  a triangle 

4 

1 

2 

1 

1-5 

Not  a triangle 

5 

3 

1 

1 

1-4-9 

Not  a triangle 

6 

2 

1 

1 

1-4-8 

Not  a triangle 

7 

2 

3 

4 

1-4-7-10-13-16-19 

Scalene 

8 

4 

3 

2 

1-4-7-11-14-17-19 

Scalene 

9 

1 

1 

1 

1-4-7-12-15-18-21 

Equilateral 

10 

2 

2 

3 

1-4-7-12-13-16-20 

. _ 

Isosceles 

simpler  than  in  the  earlier  solutions.  The  graph  of  the  flowchart  is  shown 
Jn  Figure  15.  The  members  of  the  maximum  incomparable  set  appear  with  an 


FIGURE  15  — GRAPH  DRAWN  FROM  THE  FLOWCHART  IN  FIGURE  14. 


asterisk,  and  now  there  are  only  six.  The  comparisons  in  segments  12  through 
18  are  simplified  by  the  ordering  of  the  variables  so  that , for  example , I 
cannot  be  greater  than  J,  nor  J than  K,  nor  can  I be  equal  to  K unless  it  is 
also  equal  to  J . In  an  isosceles  triangle , J must  be  one  of  the  equal  sides . 
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A structured  program  realizing  the  flowchart  of  Figure  14  is  given  in 
Appendix  C.  Six  cases  which  test  the  program  are  given  in  Table  4,  while  the 


TABLE  4 

— TEST  CASES  FOR  THE  FLOWCHART 

IN  FIGURE  14. 

Test  No. 

Data 

Path 

Results 

1 

1=1 

J=1 

K=1 

2-5-8-12-13-15 

Equilateral 

2 

2 

3 

2 

1-6-8-12-14-16 

Isosceles 

3 

3 

2 

2 

3-5-7-12-14-17 

Isosceles 

4 

2 

3 

4 

1-4-7-12-14-18 

Scalene 

5 

9 

5 

4 

3-6-9-11 

Not  a triangle 

6 

10 

5 

4 

3-6-9-10 

Not  a triangle 

test  results  are  also  shown  in  Appendix  C.  Section  4 of  this  report  shows 
how  the  size  and  number  of  the  maximum  incomparable  set  can  be  found  in  a 
formal  manner. 


2.4  Program  Writing  and  Debugging  Experience. 

As  measured  by  the  number  of  test  cases  required,  the  unstructured  pro- 
gram is  more  complex  (17  cases)  than  the  structured  program  using  essen- 
tially the  same  solution  technique  (10  cases).  An  improved  solution  tech- 
nique resulted  in  an  even  simpler  structured  program  (6  cases). 


TABLE  5 

— COMPARISON  OF  THE  THREE  DESIGNS  FOR 

THE  TRIANGLE  PROBLEM. 

Design 

Number 

of 

Inputs 

Number 

of 

Outputs 

Number 

of 

Deci- 

sions 

Number 

of 

Assign- 

ments 

Number 
of  Incom- 
parable 
Elements 

Number 

of 

Tests 

l-(Fig.  9) 

1 

4 

13 

4 

17 

17  (Table  2) 

2-(Fig.  12) 

1 

4 

6 

4 

9 

10  (Table  3) 

3- (Fig.  14) 

1 

4 

7 

3 



6 

6 (Table  4) 

' 

A comparison  of  the  three  designs  appears  in  Table  5.  Note  that  all  of 
the  designs  required  the  same  number  of  input  and  output  statements.  Design 
1 requires  17  decision  plus  assignment  statements,  while  Designs  2 and  3 re- 
quire only  10.  Thus,  the  second  and  third  designs  have  7 fewer  statements 
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each  (if  programmed  in  a higher  level  language),  than  does  Design  1.  In 
terms  of  the  number  of  type  1.5  level  tests.  Design  3 requires  the  fewest. 
Based  on  the  above  analysis,  we  have  not  only  been  able  to  assign  the  num- 
ber of  tests  required  for  each  design,  but  also  develop  information  useful 
as  a comparative  rating  of  the  designs. 

The  problem  as  given  was  so  easy  that  the  debugging  of  the  three  pro- 
grams provided  no  enlightenment.  No  logic  errors  were  found  in  any  of  the 
programs,  although  one  PL/C  syntax  error  ard  one  job  control  error  were 
found  in  the  unstructured  program,  three  input  data  errors  in  the  first  of 
the  structured  programs,  and  one  input  data  error  in  the  second.  The  re- 
ported debugging  advantages  of  structured  programming  evidently  become 
apparent  only  in  larger  programs. 


Tfrii  :>  ft.  <S~.  ''Ju 
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3.0  Relations  Among  Number  of  Paths  and  Number  of  Deciders. 

In  this  section  we  will  discuss  some  of  the  relationships  between  the 
number  of  deciders  in  a loopless  flowchart,  and  the  number  of  paths  when 
the  program  contains  no  loops.  A loopless  flowchart  is  said  to  be  strictly 
branching  if  it  contains  no  merges  other  than  a final  merge  before  the 
final  STOP.  The  two  flowcharts  in  Figure  16  are  strictly  branching.  Taking 


b. 


FIGURE  16  — TWO  STRICTLY  BRANCHING  FLOWCHARTS. 


all  the  branches  at.  two-way  branches,  the  number  of  paths  in  each  flowchart 
is  given  by: 

P * d + 1 (1) 

where  d is  the  number  of  deciders.  It  can  be  seen  from  the  flowchart  in 
Figure  16(a)  that  Eq.  (1)  always  holds.  Given  any  strictly  branching  flow- 
chart, if  any  decider  were  added  to  the  flowchart,  exactly  one  path  would 
be  added.  If  the  flowchart  contained  only  one  decider  there  would  be  two 
paths,  so  the  difference  between  p and  d is  always  1. 

If  a loopless  flowchart  contains  d deciders,  the  smallest  number  of 
paths  it  can  have  is  given  by  Eq.  (1),  and  that  value  is  obtained  when 
there  are  no  merges.  If  the  flowchart  contains  merges,  the  number  of  paths 
is  larger,  and  the  largest  number  of  paths  is  obtained  when  each  decider  is 
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followed  by  a merge,  as  In  Figure  17.  Here  the  number  of  paths  is  given  by: 

p « 2d  (2) 

so  the  number  of  paths  in  any  loopless  flowchart  is: 

d + 1 < p < 2d.  (3) 


# 


FIGURE  17  — A FLOWCHART  WITH  A MERGE  FOLLOWING  EACH  DECIDER. 


Let  ua  apply  Eq.  (3)  to  Figure  18.  Here  there  are  six  deciders,  so 
the  nuniber  of  flowchart  paths  as  given  by  Eq.  (3)  is: 


There  are  in  fact  27  paths  in  the  flowchart , and  a closer  lower  bound 
can  be  obtained  than  that  given  by  Eq.  (3)  by  decomposition  of  the  flow- 
chart at  convenient  locations.  Figure  19  shows  the  flowchart  divided 
at  the  merge  points.  Now  bounds  for  each  section  of  the  flowchart  may  be 


FIGURE  18  — A FLOWCHART  WITH  SIX  DECIDERS  AND  THREE  MERGES. 


computed  using  Eq.  (3),  and  we  find: 

3 < pi»  P2»  P3  < 4 

since  each  section  of  the  flowchart  contains  2 deciders.  The  bounds  on 
the  complete  flowchart  are  the  product  of  the  individual  bounds,  or: 

27  < p < 64. 

Note  that  the  upper  bound  is  unchanged. 

The  flowchart  appearing  in  Figure  5 may  be  similarly  decomposed  at  a 
single  merge  point.  Figure  20  shows  the  decomposition  of  the  original  13 
deciders  into  groups  of  3 and  10.  This  yields: 

4 < Pi<23 
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“ < Pi  SL  2‘ 


START 

o 

o 


o 

o 

o o 

o 

o 

o 

o 

o 

Original  (undecomposed) 
bounds ■ 

14  < p < 213 


Bounds  from  decomposition: 
....  ^ ^ .13 


44  < p < 2J 


Actual  number  of  paths : 

p = 88 


FIGURE  20  — FIGURE  5 DIVIDED  AT  ONE  MERGE  POINT. 


which  compares  to  the  original  bounds  of  8 < p < 128. 
paths  is  40. 


The  actual  number  of 


In  the  three  examples  so  far,  each  merge  point  was  a "cut  set"  of  the 
flowchart,  where  the  cutting  of  the  flow  at  the  merge  point  separated  the 
START  from  the  STOP.  In  each  of  the  three  cases  the  lower  bound  vas  im- 
proved (raised)  by  decomposition  but,  for  obvious  reasons,  the  upper  bound 
was  not  affected.  In  fact,  the  lower  bound  after  decomposition  became  a 
good  approx imation.  A different  situation  is  obtained  with  the  flowchart  in 
Figure  12.  Now  it  is  not  possible  to  find  a single  point  which  constitutes 
a cut  set  (except  trivial  ones  at  the  very  beginning  and  end),  and  it  is 
not  obvious  how  the  flowchart  can  best  be  decomposed.  The  six  deciders 
can  be  divided  into  1 and  5,  or  2 and  4,  etc.,  (if  we  limit  ourselves  to 
a two-piece  decomposition) , and  each  decomposition  gives  a different  upper 
bound,  although  the  lower  bound  remains  7 in  all  of  the  cases.  Clearly, 
that  decomposition  which  gives  the  minimum  upper  bound  is  the  best,  and 
it  is  shown  in  Figure  21.  Figure  22  summarizes  Figure  21,  and  the  numbers 
in  the  boxes  of  Figure  22  represent  the  number  of  deciders  in  each  part  of 
the  original  flowchart.  Since  the  cut  set  consists  of  two  segments,  the 
number  of  paths  through  the  flowchart  will  be  the  sum  of  the  numbers  of 
paths  through  each  of  the  segments.  Let  p^  be  the  number  of  p^  paths 
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that  pass  through  p2;  let  pL  he  the  number  of  p1  paths  that  pass  through 
P3<  Then  the  number  of  paths  through  the  flowchart  is  given  by: 


P = p|p2  + PlP3. 


(»0 


» »» 

In  this  case,  Px  “ Px  * P2  = 6111(1  ^ < P3  < 32,  so  that: 


7 < P < 33, 


compared  to  the  original  bounds  of  7 < p < 6k  without  decomposition.  The 
actual  number  of  paths  through  the  flowchart  is  11.  Other  two-piece  de- 
compositions give  higher  upper  bounds. 

It  is  possible  to  obtain  even  lower  upper  bounds  for  this  flowchart 
by  using  three-  and  four-piece  decompositions.  But  a four-piece  decom- 
position is  nearly  a block-by-block  analysis  of  the  flowchart,  and  at  that 
point  one  can  compute  the  number  of  paths  directly  as  in  [2]  . Additional 
work  is  required  in  this  area  to  determine  how  to  most  effectively  decom- 
pose flowcharts. 


& 
'H.  • 
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Since  decomposition  of  a flowchart  at  other  than  a merge  point  lowers 
the  upper  bound,  we  can  return  to  the  flowcharts  shown  in  Figures  18  and 
20  and  decompose  them  at  other  than  merge  points.  They  were  previously 
decomposed  at  merge  points  only,  thereby  raising  their  loner  bounds.  A 
three-piece  decomposition  of  Figure  18  is  shown  in  Figure  23,  and  sum- 
marized in  Figure  2k.  The  numbers  shown  in  the  boxes  of  Figure  2k  show 

I 

the  number  of  deciders  in  each  portion  of  the  decomposition.  Let  p be 

•»  1 

the  number  of  p^  paths  that  pass  through  p2;  let  p1  be  the  number  of  p^ 
paths  that  go  directly  to  p^.  Then  the  number  of  paths  through  the 
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FIGURE  23  — THREE-PIECE  DECOMPOSI- 
TION OF  THE  FLOWCHART 
IN  FIGURE  18  AT  OTHER 
THAN  A MERGE  POINT. 
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O 
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FIGURE  25  — DECOMPOSITION  OF  THE 

FLOWCHART  IN  FIGURE  20 
AT  OTHER  THAN  A MERGE 
POINT . 


Po  = 2 


• ( START 


Pi  - 2 


i J r 


-V  5<p3<16 


5 < px  < 16 


7 < p3  < 64 


h < p9  < 8 


FIGURE  24  — FIGURE  23  SUMMARIZED. 


FIGURE  26  — FIGUPE  25  SUMMARIZED. 


(5) 


P = P^  + P1P3. 

I ft 

In  thiB  case  px  * px  * 1,  pg  = 2,  and  5 < P3  < 16,  so  that: 

15  < P < 48. 


This  compares  to  the  original  undecomposed  bounds  of  7 < p < 64,  and 
the  bounds  after  decomposition  at  a merge  point  of  27  < p < Zk.  Combining 
the  results  of  both  decompositions  gives  bounds  of  27  < p < 48. 

The  flowchart  whose  outline  is  shown  in  Figure  20  may  be  decomposed 
at  other  than  a merge  point  to  reduce  the  upper  bound  dramatically  from 
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its  undecomposed  value  of  2 . The  decomposition  is  shown  in  Figure  25 

and  summarized  in  Figure  26.  The  number  of  paths  through  the  flowchart 
is  given  by: 


P = P-jPg  + P-jPg-  (6) 

In  this  case,  5 < P1  < l6,  4 < p2  < 8,  and  7 < p^  < 64,  so  that: 

55  < P < 1152. 
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U.O  Matrices  and  Zero-One  Integer  Linear  Programming 

Lipov  describes  the  properties  of  adjacency  matrices  that  can  be  con- 
structed from  the  graphs  of  Section  2 of  this  report  (which  he  incorrectly 
calls  incidence  matrices),  and  shows  how  matrix  manipulation  will  yield  in- 
formation about  the  total  number  of  pathB  in  the  flowchart.  He  does  not 
show  how  the  matrices  may  be  used  to  find  the  size  and  members  of  the  maxi- 
mum incomparable  set.  That  will  be  done  in  this  section. 

First,  the  construction  and  manipulation  of  the  matrices,  as  described 
by  Lipow,  will  be  summarized.  Then,  using  his  example,  it  will  be  shown 
how  a zero-one  integer  linear  programming  problem  can  be  formulated  in  a 
completely  mechanical  way  from  the  matrix,  whose  solution  yields  the  size 
and  members  of  the  maximum  incomparable  set.  Finally,  another  example,  a 
flowchart  with  loops,  will  be  examined. 


U.l  Matrices 

For  the  purposes  of  formulating  a linear  programming  problem  to  find 
the  maximum  incomparable  set  for  a flowchart,  it  is  necessary  to  develop 
a single  matrix  which  describes,  in  some  way,  all  of  the  connecting  flows 
that  can  be  found  in  the  flowchart.  We  do  this  by  first  constructing  an 
adjacency  matrix  from  the  graph  of  a flowchart,  in  which  the  rows  represent 
predecessor  segments  and  the  columns  represent  successor  segments.  The 
matrix  contains  a 1 wherever  a predecessor  segment  immediately  precedes  a 
successor  segment,  and  contains  a 0 everywhere  else.  Such  a matrix  can 
be  constructed  in  a finite  number  of  steps  by  first  considering  segment  1 
as  the  predecessor,  and  filling  in  a 1 for  each  of  its  successors;  then 
considering  segment  2 as  the  predecessor  and  filling  in  a 1 for  each  of 
its  successors.  No  row  need  be  constructed  for  segment  0 since  it  can 
never  be  a member  of  the  maximum  incomparable  set.  ThuB  the  matrix  will 
be  constructed  row  by  row.  The  adjacency  matrix,  M.  constructed  from  the 
graph  appearing  in  Figure  6 is  shown  in  Figure  27*  Note  that  the  ele- 
ments having  rows  with  all  zeros  constitute  an  incomparable  set.  This 
may  not  be  the  maximum  incomparable  set,  however,  as  will  be  seen  in  a 
later  example. 

From  the  matrix  M,  compute  M^,  M^,  etc.  The  matrix  M1"  represents  the 
matrix  M multiplied  by  itself  r-1  times  and  the  numerical  values  of  its 
elements  represent  the  number  of  paths  by  which  a successor  segment  can 
be  reached  from  a predecessor  segment  in  exactly  r steps.  The  set  of  ma- 
trices M,  M^,  M^,...,  exhibits  all  segments  that  can  be  reached  from 
any  other  segment  in  the  flowchart.  If  there  are  no  loops  in  the  flow- 
chart, then  k is  such  that: 
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SUCCESSORS 


1 

2 

3 

4 

5 

6 7 

8 9 

10 

11 

12 

13  14 

15 

l6  17  l8  19  20 

21 
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23  24  25  26 
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0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

1 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

p 

0 

0 

0 
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0 
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0 

0 

0 

0 

0 

0 

0 

0 

6 

0 

0 

0 

0 

0 

0 

1 

1 

0 

0 

0 
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0 

0 

0 

0 
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0 
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the  zero  matrix.  If  the  flowchart  contains  loops,  however,  the  value  of 
k may  not  he  easy  to  find,  hut  it  cannot  he  larger  than  the  number  of 
segments  in  the  flowchart.  The  number  of  segments  thus  serves  as  an  upper 
hound  on  k in  a looping  flowchart.  It  is  sometimes  possible  to  find  k in 
such  a flowchart,  and  this  will  he  done  later  in  this  section  when  the 
looping  flowchart  is  discussed. 

To  obtain  a single  matrix  exhibiting  all  segment  relationships  needed, 
we  may  sum  the  matrices  in  the  set  (by  adding  corresponding  elements ) to 
obtain  the  matrix  T: 

k 

T * Z M3".  (8) 

r=  1 


This  has  been  done  for  the  matrix  of  Figure  27,  and  the  resulting  sum  is 
shown  in  Figure  28  (c.f.  Lipow,  op.cit.).  We  may  now  construct,  from  the 
matrix  T,  a zero-one  integer  linear  programming  problem  whose  solution  is 
the  size  and  members  of  the  maximum  incomparable  set.  The  elements  with 
all  zero  rows  in  T are  the  same  as  the  elements  with  all  zero  rows  in  M, 
and  those  elements  constitute  an  incomparable  set,  but  not  necessarily 
the  maximum  incomparable  set. 


4.2  Zero-One  Integer  Linear  Programming 

To  construct  the  zero-one  integer  linear  programming  problem  (binary 
programming  problem)  whose  solution  yields  the  size  and  members  of  the 
maximum  incomparable  set,  first  form  the  matrix  F from  the  matrix  T as 
follows . 

(a)  Set  all  the  diagonal  elements  of  F equal  to  the  number  of  flow- 
chart segments  as: 

fii  * 8 i ■ 1,...,  s 

(b)  Set  the  elements  above  the  diagonal  of  F equal  to  0 or  1,  based 
upon  the  elements  of  the  T matrix  according  tc  the  following 
formula: 

lf  * V * 1<J 

lf  *«  * v ■ ‘<  •> 


(c)  Set  all  elements  below  the  diagonal  of  F equal  to  zero: 


ij 


0,  i > J 


f 

J 


X; 


yv>  ''I 

y * - • * 


32 


r 


123456789 

I 1001122444 

2 001122444 

3 000011222 

4 000011222 

5 000000111 
6 000000111 
7 000000001 
8 000000000 
9 000000000 

10  000000000 
11  000000000 
12  000000000 
T « 13  000000000 

14  000000000 

15  000000000 

16  000000000 

17  000000000 

18  000000000 

19  0 00000000 

20  000000000 
21  000000000 
22  000000000 

23  00  0 000000 

24  000000000 

25  000000000 

26  000000000 

FIGURE  28  ~ 


10  11  12  13  l4  15  16  17  18  19  20  21  22  23  24  25  26 
1(4444444444444444 
44444444444444444 
22222222222222222 
22222222222222222 
1111111111  ,1111111 
11111111111111111 
10011110011110011 
01100001100001100 
00011000011110011 
00000110000000000 
00000000000000000 
00000001100001100 
0000000  0 011000011 
00000000000110000 
00000000000000000 
0000000000000000c 
00000000000000000 
00000000000001100 
00000000000000000 
00000000000000011 
00000000000000000 
00000000000000000 
00000000000000000 
00000000000000000 
00000000000000000 
00000000000000000 

THE  MATRIX  T FOR  THE  MATRIX  M OF  FIGURE  27. 


The  binary  programming  problem  vill  use  variables  , i = 1 
and  in  the  solution: 


1 if  segment  i is  a member  of  the  maximum 
incomparable  set 


0 if  segment  i is  not  a member  of  the  maximum 
incomparable  set. 


The  binary  programming  problem  is 


subject  to 


vhere  X is  a column  vector  and  X'  ■ (x  , x 2,...,  x ),  and  S is  a column 
vector  of  order  s,  and  S'  * (s,  s,...,  s).  In  theSsolution,  the  value 
of  the  objective  function  gives  the  size  of  the  maximum  incomparable  set 
and  the  members  of  the  set  are  indicated  by  the  x.  = 1. 


As  an  example,  forming  F from  the  matrix  T in  Figure  28  yields  the 
matrix  shown  in  Figure  29.  The  binary  programming  problem  is  then: 

26 


subject  to  the  constraints  given  in  Table  6 


The  solution  to  the  binary  programming  problem  has  an  objective  value 
of  11,  and: 


all  other  x.  - 0 


giving  the  site  and  members  of  the  maximum  incomparable  set.  In  this 
case,  by  chance,  the  maximum  incomparable  set  happens  to  consist  of  the 
elements  having  all  zero  rows  in  the  M and  T matrices.  That  this  need 
not  he  so  is  shown  in  the  next  example. 
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FIGURE  29  — THE  MATRIX  F FORMED  FROM  T HI  FIGURE  28 
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^.3  A Looping  Flowchart 

The  example  used  In  Section  b.2  is  less  general  than  we  would  like  in 
several  respects: 

a)  the  members  of  the  maximum  incomparable  set  all  happen  to  be 
flowchart  terminators,  appear  at  the  bottom  of  the  graph,  and 
have  all  zero  rows  in  M and  T, 

b)  the  segments  are  numbered  in  such  a way  that  the  lower  left  por- 
tion of  the  T matrix  happens  to  contain  all  zerbs  (t. , ■ 0, 

all  i > J ) , 13 

c)  the  flowchart  contains  no  loops. 

A simple  flowchart  which  does  not  contain  these  special  conditions  is 
found  in  Figure  30(a),  and  the  graph  of  the  flowchart  in  Figure  30(b).  The 


FIGURE  30  — A FLOWCHART  ABB  ITS  GRAPH 


matrix  M is  given  in  Figure  31.  The  higher  powers  of  M are  given  in  Figure 
32.  The  upper  bound  on  k,  the  number  of  segments,  is  11,  but  in  this  case 
the  flowchart  is  simple  enough  that  the  exact  value  of  k can  be  found.  In 
any  flowchart,  looping  or  otherwise,  k is  equal  to  the  number  of  steps  in 
the  longest  path  that  can  be  traversed  in  the  graph  without  visiting  a node 
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FIGURE  31  — MATRIX  M FOR  THE  GRAPH  IN  FIGURE  30(b). 


more  than  once.  The  longest  path  may  start  and  end  anywhere  in  the  graph;  It 
need  not  start  at  START  nor  end  at  STOP.  In  a loopless  flowchart  this  value 
of  k corresponds  to  the  value  given  in  Section  h.l.  In  the  looping  flowchart 
of  Figure  30,  the  longest  path  that  does  not  visit  a node  more  than  once  is 
six  steps  long.  It  begins  at  segment  1,  and  proceeds  through  2-3-5-11-10-8* 

or  2-3-5-11-10-9.  The  value  of  k is  therefore  6,  and  Figure  32  shows  Vt 
through  M6 . » 

The  matrix  T is  shown  in  Figure  33.  Matrix  F is  shown  in  Figure  31*. 
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FIGURE  33  — T FOR  THE  SET  OF  MATRICES  OF  FIGURES  31  and  32. 
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FIGURE  34  — MATRIX  F FROM  THE  MATRIX  T OF  FIGURE  33. 


The  binary  programming  problem  is: 

II 

maximize  Z 

i=  1 


subject  to: 
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The  solution  has  an  objective  value  of  three,  and: 


fi  ■ 5,6,7  1 
t.  - 1,  (i  - 6,7.10 > 
Li  - 6,7, 11J 


all  other  x. 


The  objective  value  of  three  indicates  that  the  maximum  incomparable  set 
contains • three  elements,  and  hence  that  three  tests  are  needed  to  exe- 
cute every  segment  of  the  flovchart  at  least  once.  The  variables  x^ 

indicate  which  segments  must  be  tested  in  the  test  cases.  Here  there  are 
three  optimal  solutions  to  the  binary  programming  problem,  and  any  one 
of  the  three  could  be  used  with  equivalent  results.  In  the  first  solu- 
tion, the  Indicate  that  segments  5,  6,  and  7 must  be  each  executed 

once  and  only  once  in  the  three  test  cases.  Equivalently,  the  other 
two  solutions  indicate  that  segments  6,  7,  and  10  must  be  tested  once 
and  only  once;  or  that  segments  6,  7,  and  11  must  be  so  tested. 

4 . 4 Matrix  Reductions 

Sometimes  the  matrix  F can  be  reduced  by  elimination  of  rows  or 
rows  and  columns,  and  sometimes  some  of  the  variables  can  be  removed 


v -•T"- 


f 


from  the  vector  X and  from  the  objective  function  and  set  equal  to  0 or  1 be- 
fore solution  of  the  binary  programming  problem  is  begun. 

If,  for  any  variable  x^ , all  the  elements  in  column  r of  F above  the 

main  diagonal  are  equal  to  1,  and  all  the  elements  in  row  r of  F to  the 
right  of  the  main  diagonal  are  equal  to  1,  that  is,  if: 


f^r  * 1 for  all  i < r,  and 

(9) 

f r j * 1 for  all  J > r 


then  remove  x from  X and  from  the  objective  function,  set  x =0,  and  remove 
r r 

row  r and  column  r from  F,  unless  reduction  (9)  holds  for  all  r.  If  reduc- 
tion (9)  holds  for  all  r,  then  the  binary  programming  problem  is  a trivial 
one,  with  an  objective  value  of  one,  and  with  any  one  variable  comprising 
the  maxi mum  incomparable  set. 

If,  for  any  variable  x , all  the  elements  of  column  r and  row  r of  F 

r 

above  and  to  the  right  of  the  main  diagonal  are  zero,  that  is,  if: 


f^r  ■ 0 for  all  1 < r,  and 

f . * 0 for  all  J > r 
rJ 


(10) 


then  remove  x from  X and  from  the  objective  function,  set  x = 1,  and  re- 
r r 

move  row  r and  column  r from  F.  Also  check  for  a flowcharting  or  program- 
ming error,  for  this  condition  indicates  that  segment  r cannot  reach  any 
other  segment  nor  is  it  reachable  from  any  other  segment. 

If,  for  any  variable  x^ , column  r of  F contains  at  least  one  non-zero 

element  above  the  main  diagonal  and  all  the  elements  of  row  r of  F to  the  right 
of  the  main  diagonal  are  zero,  that  is,  if: 


fir  ■ 1 for  any  i,  and 

f • 0 for  all  J > r 
rj 


(11) 


In  Figure  3^ , reduction  (9)  permits  the  removal  of  rows  1,  2,  and 
3,  and  columns  1,  2,  and  3 from  F,  along  with  the  removal  of  x^,  x^, 

and  x^  from  X and  from  the  objective  function,  and  the  setting  of 

« x2  * x^  * 0.  Reduction  (ll)  permits  the  removal  of  row  11  from  F. 

The  reduced  F from  Figure  3^  is  shown  in  Figure  35. 
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FIGURE  35  — THE  REDUCED  MATRIX  FROM  FIGURE  3U. 

*+.  5 Additional  Comments  on  the  Matrices 

The  matrices  M,  M2,...,  M^  by  themselves  yield  information  about  the 
flowchart  and  graph,  aside  from  their  usefulness  in  forming  T and  the 
linear  programming  problem. 


For  example,  ir.  any  matrix  where: 


+ 0 


a loop  is  indicated.  If  r * 1,  then  the  loop  is  a "self-loop,"  or  a 
one-step  loop,  where  the  flow  returns  to  the  same  decider  In  one  step. 
If  r > 1,  then  r is  the  number  of  segments  in  the  loop.  In  Figure  31, 
m22  * lndlcatlnS  * self-loop  in  node  2. 


Any: 


m£j  } >1  i * j 

indicate  parallel  paths  between  segment  i and  segment  j.  Parallel  paths 
cannot  occur  with  r = 1,  but  for  matrices  of  higher  powers  parallel  paths 

( u ) 

are  frequently  found.  For  example,  in  Figure  32  m,  ' = 3,  indicating  that 

there  are  three  different  ways  to  go  from  segment  2 to  segment  9 in  four 
steps.  Different  numbers  of  times  around  a loop  are  considered  a differ- 
ent way  to  go,  and  the  three  ways  are  2-3-4-6-9  , 2-3-4-7-9,  and  2-3-5-10-9. 


4.6  Upper  and  Lower  Bounds  on  the  Number  of  Tests  Needed 

Using  the  flowchart  in  Figure  36  (decisions  tested  only  two  ways,  not 
three)  with  its  segments  numbered,  and  following  the  methods  in  Section  2 
and  Sections  4.1  through  4.3,  the  matrices  M and  T may  be  constructed  with 
k = 7 (Table  4).  The  methods  of  those  sections  also  yield  5 as  the  size 
of  the  maximum  incomparable  set,  which  is  the  lower  bound  on  the  minimum 
number  of  tests  needed  to  pass  through  every  segment  at  least  once. 

The  actual  minimum  number  of  test  cases  required  will  depend  on  the 
contents  of  the  flowchart  boxes.  It  is  conjectured  that  sufficient  con- 
ditions for  achieving  the  lower  bound  are: 

a)  the  decisions  are  all  independent  of  one  another, 

b)  the  decision  variables  are  all  read  as  input, 

c)  the  program  does  not  modify  the  values  of  the  decision  variables. 

If,  on  the  ether  hand,  the  decisions  have  a certain  degree  of  depen- 
dence, the  lower  bound  may  not  be  achievable  (as  in  the  flowchart  in  Fig- 
ure 12).  The  flowchart  in  Figure  37,  for  example,  has  the  same  structure 
as  that  in  Figure  36,  but  cannot  be  tested  with  only  five  cases.  Owing  to 
the  dependence  of  the  decisions,  six  tests  are  needed  in  order  to  pass 
through  every  segment  at  least  once.  There  are  several  different  sets  of 
six  tests  which  will  exercise  every  segment,  but  no  set  smaller  than  6. 

By  changing  the  contents  of  the  boxes  in  the  flowchart  in  Figure  37, 
it  is  possible  to  create  a different  flowchart  (but  with  the  same  struc- 
ture) that  will  require  seven  tests  to  exercise  all  segments. 

In  the  case  of  a flowchart  without  loops,  the  upper  bound  on  the 
minimum  number  of  test  cases  needed  to  pass  through  every  segment  at 
least  once,  u,  is  given  by: 


u = d + 1 


44 


T 


13 


t 


T 


( 

i 

where  d is  the  number  of  deciders  in  the  flowchart.  (This  is  the  same  for- 
mula as  the  one  for  determining  the  smallest  number  of  paths  that  a flow- 
chart may  have,  given  the  number  of  deciders  in  the  flowchart,  as  given  in 
Section  3.0.) 


Proof : Consider  a flowchart  with  no  deciders.  Such  a flowchart  has  one 
segment  and  requires  one  test.  Each  decider  added  to  the  flowchart  can 
require  at  most  one  additional  test,  so  u = d + 1.  (This  proof  bears  some 
resemblance  to  the  derivation  of  the  formula  in  Section  3.0,  although  there 
is  no  obvious  connection  between  the  two.)  QED 

4.7  Calculating  the  Number  of  Paths  and  Enumerating  the  Paths  in  a Flow- 
chart, using  Matrices 

The  matrix  T in  Table  4 can  be  used  to  readily  reveal  the  total  number 
of  paths  in  the  flowchart  of  Figure  36,  as  shown  by  Lipow  in  [1].  Since  all 
paths  begin  at  segment  1,  and  end  either  at  segment  4,  5,  6,  or  7,  the  total 
number  of  paths,  p,  is* 


P = tl,4  + tl,5  + tl,6  + tl,7* 


This  is  seen  to  be  20,  a number  which  can  be  obtained  also  by  the  de- 
composition method  described  in  Section  3 or  by  the  direct  calculation 
method  described  by  Shooman  in  [2]. 

An  enumeration  of  the  20  paths  may  be  generated  from  the  matrix  M,  and 
the  enumeration  takes  the  form  of  a tree. 


The  tree  is  built  level  by  level,  with  each  bottom  terminus  of  the 
tree  directing  to  a row  of  M,  until  construction  of  the  tree  terminates 
due  to  a row  of  M containing  all  zeros.  This  process  was  applied  to  the 
flowchart  of  Figure  36,  and  the  result  is  shown  in  Figure  38,  showing 
the  segments  that  comprise  each  of  the  20  paths  in  the  flowchart. 

The  paths  so  enumerated  can  now  be  represented  by  a matrix,  which 
will  prove  useful  in  Section  4.8.  In  the  matrix,  P,  each  column  repre- 
sents a path,  and  contains  a 1 for  each  segment  in  the  path.  The  matrix 
P from  the  tree  in  Figure  38  is  given  in  Figure  39. 


FIGURE  38  — A TREE  SHOVING  ALL  THE  PATHS  IN  THE  FLOWCHART 
OF  FIGURE  37. 


Further  work  is  needed  to  develop  a method  of  generating  P from  M 
by  matrix  operations,  without  the  intervening  tree  enumeration. 


1 2 3 U 5 6 7 8 9 10  11  12  13  lU  15  16  17  18  19  20 


3 

1* 

5 


1 6 

7 

P - 8 

9 

10 

11 

12 

13 

lU 

15 


111111111  1 
111100000  0 
110011001  1 
100010001  0 
010001000  1 
001000100  0 
000100010  0 
001100110  0 
000000001  1 
000000000  0 
000000000  0 
000011110  0 
000011111  1 
000000001  1 
000000001  1 


1111111 
0 0 0 0 0 0 0 

0 0 1 1 0 0 1 

0 0 1 0 0 0 1 

0 0 0 1 0 0 0 

1 0 0 0 1 0 0 

0 1 0 0 0 1 0 

1 1 0 0 1 1 p 

1 1 0 0 0 0 0 

0 0 11110 
0 0 0 0 0 0 1 

0 0 0 0 0 0 0 

1111111 
1111111 
1111110 


111 
0 0 0 
10  0 
0 0 0 
10  0 
0 10 
0 0 1 
Oil 
0 0 0 
0 0 0 
111 
0 0 0 
111 
111 
0 0 0 


FIGURE  39  — THE  PATH  MATRIX  FOR  THE  PATH  TREE  IN  FIGURE  38. 


U.8  Finding  the  Actual  Minimum  Number  of  Tests  Needed 

To  find  the  minimum  number  of  tests  needed  for  any  given  flowchart, 
start  with  the  path  matrix  P and  remove  any  columns  which  represent  In- 
feasible paths.  For  example , to  find  the  minimum  number  of  tests  for 
the  flowchart  in  Figure  37,  remove  from  P (Figure  39)  columns  which 
represent  paths  that  cannot  be  traversed.  One  such  path,  for  example, 
consists  of  segements  1,  2,  8,  and  7*  It  cannot  be  traversed  because 
of  the  vay  M is  set. 

The  flowchart  in  Figure  37  1b  small  enough  that  the  infeasible  paths 
can  be  found  by  inspection.  For  larger  flowcharts,  it  may  be  possible  to 
use  logical  operations  (AID,  OR,  etc.)  to  detect  Infeasible  paths.  So 
far,  work  on  the  use  of  logical  operations  to  detect  Infeasible  paths  has 
not  yielded  satisfactory  results.  See  [3j. 

In  very  large  flowcharts  where  flow  relationships  are  less  obvious, 
it  may  not  be  possible  to  find  and  remove  all  infeasible  columns  from  P. 
Such  a defect  is  not  fatal,  however,  and  can  be  remedied  by  a procedure 
to  be  explained  later. 

After  the  infeasible  columns  are  removed,  the  remaining  matrix,  U, 
can  be  used  to  construct  a binary  programming  problem  whose  solution  is 
the  number  of  test  cases  required,  and  the  paths  that  those  test  cases 
should  traverse.  Let  J be  the  index  set  of  the  feasible  paths.  Then  the 
binary  programming  problem  is: 


U9 


f 


minimize  z = Z  1 * * * * * * * *  Xi 

j c J 


subject  to: 


UX  < 1 


xj  = o»i 


where  X is  a vector  whose  transpose  is  C x ^ | j 6 J).  The  solution  yields  a 

value  for  z which  is  the  actual  minimum  number  of  tests  needed  to  pass 
through  all  segments  at  least  once.  The  variables  refer  to  the  j 

feasible  paths,  and  in  the  solution  to  the  binary  programming  problem: 


Xj  = 


1,  if  path  j is  one  of  the  paths 
to  be  traversed  by  a test 


0,  otherwise 


As  an  example,  the  10  feasible  paths  from  P in  Figure  39  are  1,  2,  7, 
8,  11,  12,  15,  16,  19,  and  20.  So  the  binary  programming  problem  is: 


minimize  z 


■Z 


j = 1,2,7,8,11,12,15,16,19,20 


subject  to: 
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1 

0 

0 

0 

1 

1 
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0 

0 

0 

0 

0 

1 

1 

1 

0 

0 

0 

1 

1 
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1 

0 

0 

0 

0 

1 

0 

1 

0 

1 

0 

0 

1 

1 

1 


1 

0 

0 

0 

0 

0 

1 

1 
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0 

0 

1 

1 
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1 

0 

0 

0 

0 

1 

0 

1 

0 

0 

1 

0 

1 

1 

0 


1 

X1 

1 

0 

1 

0 

X2 

1 

0 

X7 

1 

0 

1 

0 

X8 

1 

1 

X11 

1 

1 

X 

V 

< 

1 

0 

X12 

1 

0 

X15 

1 

1 

1 

0 

X16 

1 

1 

X19 

1 

1 

1 

0 

X20 

1 

‘j  = 0,1;  j f J 
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This  is  a standard  form  set  covering  problem,  and  the  matrix  reduc- 
tions given  by  Garfinkel  and  Nemhauser  [4]  may  be  applied  to  U.  By  their 
Reduction  U,  r1  > rg  - r^  > r^,  so  rows  1,  2,  and  3 are  eliminated.  Also 

by  U,  rg  = r13  > r^  > r^  > r^,  so  rovs  8,  13,  14,  and  15  are  deleted. 

By  reduction  2,  r^  * e^,  so  row  4 and  column  1 are  deleted,  and  x^  * 1. 

Also  by  2,  r^  * e^,  so  row  5 end  column  2 are  deleted,  and  xg  * 1.  The 

problem  that  remains  is: 

Minimize  z'  * ^ x,  J ■ 7,8,11,12,15,16,19,20 

J 

subject  to: 

7 8 11  12  15  16  19  20 
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1 

0 

1 

0 

1 

0 

1 

0 

X7 

1 

x8 

7 

0 

1 

0 

1 

0 

1 

0 

1 

1 

X11 

9 

0 

0 

1 

1 

0 

0 

0 

0 

X12 

< 

1 

10 

0 

0 

0 

0 

1 

1 

0 

0 

*15 

1 

11 

0 

0 

0 

0 

0 

0 

1 

1 

xl6 

1 

X19 

12 

1 

1 

0 

0 

0 

0 

0 

0 

X20 

1 

X 

M 

1 

0, 

is 

3 

e j 

There  are  lU  optimal  solutions,  vlth  z'  ■ 4.  Some  of  them  are: 


VXll‘X15“X20*1 

all  other  Xj«0 

x7*xll*xl6*x19*1 

all  other  Xj»0 

X7“X11*X16MX20“1 

all  other  Xj»0 

X7“X12"X15"X19"1 

all  other  Xj«0 

X7“X12“X15"X20"1 

all  other  Xj«0 

Thus  the  corresponding  solutions  to  the  original  problem  have  z-6, 

and: 


This  says  that  6 tests  are  required  to  pass  through  all  segments  at 
least  once,  and  the  6 tests  should  traverse  paths  1,2,7,11,15,  and  20  as 
those  paths  are  defined  in  the  matrix  U. 

As  mentioned  earlier,  the  matrix  U may  sometimes  contain  some  infea- 
sible paths,  if  the  flow  relationships  in  P were  not  sufficiently  obvious 
for  the  detection  and  removal  of  all  infeasible  paths.  In  such  a case, 
one  or  more  infeasible  paths  may  appear  in  the  solution  of  the  binary 
programming  problem.  Then,  when  an  attempt  is  made  to  construct  test 
data  to  traverse  the  paths  in  the  solution,  the  infeasible  paths  will  be 
detected.  At  that  time  they  can  be  removed  from  U,  and  the  binary  pro- 
gramming problem  solved  again.  The  process  can  be  repeated  if  necessary 
until  a solution  free  of  infeasible  paths  appears*. 

The  essential  features  distinguishing  the  procedure  described  in  this 
section  from  the  binary  programming  problem  of  Section  4.2  are: 

In  Section  4.2,  a matrix  F was  used  to  find  a maximum  incomparable 
set.  F is  a square  matrix  whose  dimension  is  equal  to  the  number  of 
segments  in  a flowchart.  Even  in  a large  flowchart  the  number  of  seg- 
ments might  not  be  more  than  several  hundred,  and  usually  the  number  of 
segments  is  much  smaller  and  manageable  in  a practical  way.  F was  used 
to  form  a maximization  problem,  in  which  the  solution  is  the  maximum  in- 
comparable set  of  segments,  and  also  the  lower  bound  on  the  minimum  num- 
ber of  tests  needed  to  pass  through  each  segment  at  least  once. 

In  this  section  a matrix  U is  used  to  find  a minimum  number  of  tests. 
In  general,  U is  not  square.  The  number  of  rows  equals  the  number  of  seg- 
ments in  the  flowchart,  but  the  number  of  columns  equals  the  number  of 
feasible  paths.  Even  in  a modestly-sized  flowchart,  the  number  of  fea- 
sible paths  may  be  very  large  and  not  easy  to  find.  U is  used  to  form 
a minimization  problem,  and  the  solution  is  the  minimum  number  of  feasi- 
ble paths  needed  to  pass  through  ("cover")  every  segment  at  least  once. 

Further  work  is  needed  to  develop  methods  of  deriving  U in  a manner 
that  is  practical  for  real  flowcharts.  Also,  later  an  attempt  will  be 
made  to  apply  the  methods  of  this  section  to  flowcharts  with  loops. 


5.0  Summary  and  Conclusions 


An  algorithm  for  finding  the  maximum  incomparable  set  has  been  des- 
cribed. It  consists  of  forming  a graph  from  a flowchart,  and  then  form- 
ing an  adjacency  matrix,  performing  matrix  operations,  and  finally  form- 
ing a zero-one  integer  programming  problem  and  solving  it.  The  size  of 
the  maximum  incomparable  set  serves  as  a lower  bound  on  the  number  of 
test  cases  required,  and  the  members  of  the  maximum  incomparable  set  are 
the  segments  through  which  program  test  cases  must  pass.  Ideally,  it 
may  be  possible  for  the  tester  to  construct  test  cases  so,  that  one  and 
only  one  will  pass  through  each  of  the  segments  of  the  maximum  incompar- 
able set.  Sometimes,  due  to  the  information  contained  in  the  segments, 
it  is  not  possible  to  construct  such  test  cases,  and  the  actual  number 
of  tests  needed  to  test  all  segments  will  be  larger  than  the  size  of  the 
maximum  incomparable  set.  The  size  of  the  maximum  incomparable  set  serves 
as  a lower  bound  on  the  number  of  test  cases  required.  A formula  for  the 
upper  bound  on  the  minimum  number  of  test  cases  required  was  given  for 
loopless  flowcharts  with  two-way  decisions.  A method  for  finding  the  ac- 
tual minimum  number  of  test  cases  using  binary  programming  was  given. 

The  relationship  between  flowchart  structure  and  the  number  of  flow- 
chart paths  was  examined.  It  is  possible  to  compute  upper  and  lower 
bounds  on  the  number  of  paths  in  a loopless  flowchart  from  just  the  number 
of  deciders  in  the  flowchart.  Improved  bounds  can  be  obtained  by  decom- 
posing the  flowchart  and  computing  bounds  for  each  portion,  and  then  com- 
bining the  individual  bounds  in  a way  that  depends  on  the  original  decom- 
position. Further  work  should  be  directed  toward  determination  of  how  the 
bounds  are  affected  by  the  method  of  decomposition,  and  toward  finding 
the  best  methods  of  decomposition. 
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APPENDIX  C 
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